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ABS!CB1CT 

This paper preaents the rationale for and affects of 
utilizing both gualltatlTe and quantitative analyses in naturalistic 
z^^mmnch* Ihe specific research project examined was titled 
"llternative Patterns for strengthening Coaaunity Service Programs in 
Institutions of Higher Iducation*" (The project was a 2*year 
nationvlde study conducted through the University of Illinois at 
Urbana^Champalgn and focused on alternatives used by decisionjaakers 
Is a variety of settings in which it was thought that strengthening 
and continuation of comaunitj service programs had occurred as a 
result of developmental efforts funded under title I (HEA^ 1965) « 
Data gathered from field interviews in six States were analyzed 
fualltatively through the use of content analysis and quantitatively 
through the use correlational and multivariate analyses*) The body of 
this paper dewribes the research approach used in the project in 
terms of the various activities that were undertaken, their 
Relationships to each other and why they were done, concluding that 
(1) the complementary use of qualitative and, guMtitative analyses 
proTlded a basis by which the results of the data analysis of the 
first and second years could be compared | and (2) when qualitative 
and quantitative findings from each year were compared, findings from 
the first year were generally substantiated and extended, (SH) 
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Rationale For and EffectH of Utilizing Both 
Qualitative and Quatititative Analyses in 
a Naturalistic Rasearch Project 

Rasearchers in education, as i^ell as in other disciplines , have long debated 
the ralative merits and uses of qualitative and quantitative methods of data 
analysis. Soma researchara have found that a conabination of quaiitativa and 
quantitative methods may be used to good advantagej especially in naturalistic 
research. In naturalistic reiearchj investigators take natural settings, already 
eatabliahed and functioning, and add a data collection dimension so that they 
can draw conclusions about the relative effectiveness of various alternative 
patterns selected and implemented by decision maicers in those aettings. The 
purpose of this paper is to share i*ith you the rationale for and effects of utili- 
sing both qualitative and quantitative analyses in a specific naturalistic research 
project i^^ntitled "Alternative Patterns :Jar Strengthaning Community Service Programs 
in Institutions of Higher Education^" 

The study was designed to extend to a multi-stata sample an eKploratory 
process that had begun in a similarp related study in California, One of che 
objectives of the "Alternative Patterns,*," study was to begin to systemetiEe 
knowledge about patterns and strategies that can strenRthen community service 
pjrograms in institutions of higher education and lead to their continuation 
once external developmental funds are no longer provided to an institution. 

Although it was an exploratory study, the "Alternative Patterns,,," study 
was a systematic inquiry which utilised both qualitative and quantitative analyses* 
The qumlltative analyses reflected the exploratory and basically inductive' 
nature of the study* The quantitative analyses provided a deductive component 
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within the inductive oriente^tion of the study. Thus, building theory was the _ . 
principal goal of the study, but validating theory that was mainly inductively 
generated was an ongoiag process accomplished primarily through the use of quanti 
tatlva analyses. The interaction of the inductive and daductive approaches 
using qualitative and quantitative analyses will be the general theme of the 
^comments which follow. 

In order to facilitate an understanding of the research approach used in the 
"Alternative patterns,*," study, let me describe the various activities that 
were undertaken^ their relationships to each other, and why they were done. The 
attached functional flow of activities chart may be a useful reference* 

Many of the initial activities provided an information and theory base which 
affected the nature of later activities. Beginning in the first two months, 
literature related to Title I (HEA, 1965) was reviewed, Latar^ state guidelines, 
evaluations, and individual project reports in states where interviewing was to 
be conducted were read. Similarly^ In-process consultations with the staff of 
the Gomfflunity Service and Continuing Education Program of the U.S. Office of 
Education were initiated in the first two months of the study to facilitate the 
identification of relevant literature and the selection of appropriate interview 
sites^ These consultations were conducted periodically to maintain communication 
and especially to acquaint persons involved at the national level with the study' i 
emerging findings^ Liaison with the staff of the related California study was 
established to share methododology, emerging findings, and conceptualisation as 
the two studies progressed^ 

Sampling procedures were deiigned to ensure representativeness and to be 
eoniistent with the exploratory purpose of the study. Dimensional sMpling 
(Arnold, 1970) was used to select the itates and inititutions within those states 



from which data were obtained. The dimensions that were used for sampling purposef 
included the following- 

1, Types o£ state o-jidelirics for implamantins Title I (IIMj 1965); 

2* Geographical digtrlbutiDn; 

3, Urban j suburban, and rural settinps; 

4p Types of i'liStttutipns of higher educatton; 

5, Types of community problams addressed | 

6, Types of interviav7ee role p^r fc';^entives within institutions of higher 
education. 

The states included in the sample were seleatcd particilly on the basis of 
the above dlmenMtnns and partially on the ba^is of having successful state Title 
I (HEAs 1965) progrfuun^ Tht institutions within each stEte were selected on 
similar bases. The staff baltaved that tmrm could be learned about the strength- 
ening and continuation processes by examining states and in.ntituT::ions in which 
considerable strengthening and continuation raportadly had occurred* 

The data were collected systematically in each state, Defors field inter- 
viewing began in each state^ a day-long trani^*: ctiva semini^r was held, with the 
state Title I director, pereons in the state knowledgfiabla about community problems 
and efforts to solve them^ and mamberi of the "Alernattve Patterns,.**' staff 
participating. These ieminars ware designed to help Identify trends affecting 
cooimunity service and continuing education in the itatej and to help identify 
factors affecting specific institutional programs. 

The actual fisld interviei^Sj of which nearly three hundred were conducted 
during the two years of the study^ utilised elite and specialiied interviewirig 
(Dexter^ 1970). In this type of interviewingi the interviewer allows the Inter- 
vieij^ae to teach him or her what the problem, question, or situation is| it rellee 



on the interviewees' notion of what is relevant* The main function of the inter^ 
viewer is to focus attention on a given experience and its effects rather than to 
ask specific questions. 

Elite and specimliged interviewing is done with an interview guide consistino 
of Open-ended questions generated, in this atudyj from relevant literatures in- 
process consultations J and transactive ieminars. The interview guide changed 
somewhat during the course of the study to reflect the developing knowledge of the 
strengthening and continuation process. While it remained inductively oriented 
throughout the itudy^ it was used during the second year to check as well as to 
extend the findings of the first year. 

The data analysis procedures were similarly refined during the course of the 
study. Initially j forms of content analysis (MertoSp 1968) such as themetic 
analysis and structural analysis were used. The data were classified within 
inductively generated categories of themes , structures ^ and pattiarns* Each of 
these categories was then eKamined to determine its subcategories ^ its interrela- 
tionship with other categories, and its relationship to the data as a whole. In 
this process, the analysis focused on what had been reported in the interviews 
concerning the nature and eKtent of the strengthening and continuation outcomes 
and the factors that were found to facilitate or hinder these outcomes. 

The mount and complexity of the data and the large ntraber of inductively 
generated categories and subcategories made the qualitative analyses of relation- 
ahipa among and within categories difficult. The relationahip of a few factors 
to certain outcomes in individual projects was understood. However^ the complexity 
of the data meant that it was extremely difficult to determine the relative effect 
and importance of these factors and out*;omes across projects and institutions 
using only qualitative analysis. 
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RecDgniging the compleKicy of the datflp tha decision was made to utilize 
quantitativa analyses to complement rather than to replace qualitative analyses* 
Inltiallyj the quantitative analyses provided clues about the relationships among 
and within the outcomes and factors that had been qualitatively identified ^ and 
they provided a means by which the qualitative findings could be confirmed or 
denied, Ag the study progressed, quantitative analyses became increasingly 
important as a means by which to test findings and insights. Quantitative analyses 
thereforsj were used to suggest relationships and to confirm developing concepts 
and theories; they were not used primarily to generate new theoretical insights, 

With the anticipated use of the quarititative analyses clearly in minds the 
process of converting the qualitative data to a form useable in quantitative 
analyses was begun* Using individual Title I projects as the units of analysis, 
the categories (the strengthening and continuation ©utcomea and the factors 
effecting the outcomes) that had been Inductively generated from the qualitative 
data had to be further refined and defined in order to permit a high degree of 
inter-rater reliability* Appropriate ways to measure these categories had to be 
determined. 

The method by which the outcomes and factors affecting outcomes were measured 
deserves at least a brief description* For each Title I project examined^ each 
outcome was rated (hleh, middle^ or low) according to the degree to which strength- 
ening or continuation had occurred, ^e increases in size, energy, and centrality 
were the criteria on which these Judgments were made^ The factors affecting the 
outcomaa were rated in different ways, depending on their nature. Some were rated 
according to their degren of presence | these were dlchotomous or limited choice 
faccora for which only one rating was appropriate* Some factors were rated 
according to the presence or absence of their subcategories* For a few factors, 
aubcatagarles were rated and a composite rating for each factor was obtained. 
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Tha identification and maasurament of outcomas and factors after the second 
ymmt utilised the axparlanca of the first year. In the iecond year, a greater vari- 
ety of factors was identified. More of the factors were ratad to allow analyses 
of both their subcategories and their total effect^ More comprehensive measures 
were desired because the qualitative analyses that were occurring simultaneously 
Indicated that one diinenaional ratings did not answer adequately some important 
questions. 

The complementary nature of qualitative and quant it at Ive analyses and the 
mlKing of inductive and deductive approaches in this study are further illustrated 
by the pattern used to report the findings of the study. For each itrangthening 
and continuation outcome and for each factor thought to affect these outcomes^ the 
range of responses was reported. The qualitative findings and the quantitative 
findings were then presented and compared. The slnillarltles and differences between 
the qualitative and quantitative findings and between the actual and expected 
findings were identified and discussed. 

Although many types of analyses were used, the findings and conclusions of the 
study were generated prlEaarily from the qualitative analyses and validated primarily 
by the quantitative analyses. The qualitative analyses utilised the statements of 
Interviewees about the nature of the outcomes^ the factors affecting them, and their 
interrelationships^ these types of analyses were consistent with the basically 
Inductive orientation of the study. The quantitative analyses, on the other hand^ 
utilised correlations and multivariate analysis of variance (M4N0VA) to teat the 
insights derived from the qualitative analyses. 

The conclusions contained in the final report of the study were developed through 
a series of successive approximations. While quantitative analyses playe4v.a,.,second- 
ary role in this process^ they provided valuable ^ periodic feedback about theaccura^of 
the emerging conclusions and helped to keep the qualitative analyses on a produet^ive pathi 
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Because of the inductive and exploratory nature of the study, refinements in 
the methoda and Instrumenti of data gathering and analysis during the second year 
produced motm preciee and conilstent results than In the firat year, Thaaa 
refinements, for the most part, resulted from the Inereaaed understanding made 
possible by the complementary use of qualitative and quantitative analyses. For 
exmple, the process of quantification provided greater conceptual clarity by 
demanding praeieion in the tdentiflcation of the conceptual categories and thair 
subcategories » Greater attention was paid to the subcategoriea of the factors 
and to their relatlonahlps to the strengthening and continuation outcomes. 

By providing focus to a complex study, the quantitative analyses resulted in 
the development of an interview guide that was more specific In the second year 
than in the first year. This interview guide, because of Its sharper focus, facili 
tated the qualitative analyses of the strengthening and enntlnuation outcomes and 
of the factors which affected these outcomes. 

The complamentary use of qualitative md quantitative analyses provided a 
basis by which the results of the data analysis of the first mi second years 
could be compared. The findings from the first year's data wer# used to predict 
findings from the second year's data. Whan qualitative and quantitative findings 
from each year were compared, findings from the first year were ganarally substan- 
tiated Md eKtendad. Of course, the prediction could have been made using only 
qualitative analyaes, but It would have been considerably lass useful without 
the greater precision and Inclugiveneas made possible by quantitative analyses. 
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